Automatic detection and tracking of pedestrians from a moving stereo rig
نویسندگان
چکیده
We report on a stereo system for 3D detection and tracking of pedestrians in urban traffic scenes. The system is built around a probabilistic environment model which fuses evidence from dense 3D reconstruction and image-based pedestrian detection into a consistent interpretation of the observed scene, and a multi-hypothesis tracker to reconstruct the pedestrians’ trajectories in 3D coordinates over time. Experiments on real stereo sequences recorded in busy inner-city scenarios are presented, in which the system achieves promising results.
منابع مشابه
A Fast Stereo-based System for Detecting and Tracking Pedestrians from a Moving Vehicle
In this paper we describe a fully integrated system for detecting, localizing, and tracking pedestrians from a moving vehicle. The system can reliably detect upright pedestrians to a range of 40 m in lightly cluttered urban environments. The system uses range data from stereo vision to segment the scene into regions of interest, from which shape features are extracted and used to classify pedes...
متن کاملDetecting Pedestrians with Stereo Vision: Safe Operation of Autonomous Ground Vehicles in Dynamic Environments
This paper describes an integrated system for real-time detection and tracking of pedestrians from a moving vehicle. We use stereo vision as the primary sensor, and show that this sensor has a number of practical advantages over monocular vision. These include the ability to quickly identify regions-of-interest in an image, classify these regions based on shape, and track detected pedestrians i...
متن کاملObject Detection and Tracking for Autonomous Navigation in Dynamic Environments
We address the problem of vision-based navigation in busy inner-city locations, using a stereo rig mounted on a mobile platform. In this scenario semantic information becomes important: rather than modelling moving objects as arbitrary obstacles, they should be categorised and tracked in order to predict their future behaviour. To this end, we combine classical geometric world mapping with obje...
متن کاملThree-dimensional tracking of multiple skin-colored regions by a moving stereoscopic system.
A system that performs three-dimensional (3D) tracking of multiple skin-colored regions (SCRs) in images acquired by a calibrated, possibly moving stereoscopic rig is described. The system consists of a collection of techniques that permit the modeling and detection of SCRs, the determination of their temporal association in monocular image sequences, the establishment of their correspondence b...
متن کاملResults from a Real-time Stereo-based Pedestrian Detection System on a Moving Vehicle
This paper describes performance results from a real-time system for detecting, localizing, and tracking pedestrians from a moving vehicle. The end-to-end system runs at 5Hz on 1024x768 imagery using standard hardware, and has been integrated and tested on multiple ground vehicles and environments. We show performance on a diverse set of groundtruthed datasets in outdoor environments with varyi...
متن کامل